Papers with text classification models
The Authors Matter: Understanding and Mitigating Implicit Bias in Deep Text Classification (2021.findings-acl)
Copied to clipboard
| Challenge: | Existing studies on text classification have focused on the bias towards the individuals mentioned in the text content. |
| Approach: | They propose a framework to mitigate implicit bias in text classification models based on demographic attributes of authors . they propose to use this framework to train deep text classifiers to make predictions on the right features . |
| Outcome: | The proposed framework outperforms existing models significantly in fairness and performance. |
Arabic Synonym BERT-based Adversarial Examples for Text Classification (2024.eacl-srw)
Copied to clipboard
| Challenge: | Often, research studies quantifying the impact of adversarial text attacks have been applied only to models trained in English. |
| Approach: | They propose a word-level study of adversarial text examples in Arabic . they use a synonym attack with a BERT model to assess their robustness . |
| Outcome: | The proposed attack compares Arabic adversarial examples with their original examples and regains 2% accuracy after training. |
Predicting Algorithm Classes for Programming Word Problems (D19-55)
Copied to clipboard
| Challenge: | Using a text classification problem, we map programming word problems to relevant classes of algorithms. |
| Approach: | They propose to map programming word problems to relevant classes of algorithms by using a text classification problem as a classification task. |
| Outcome: | The proposed algorithm class prediction is 9 percent lower than a human on the task. |
Robustness Evaluation of Text Classification Models Using Mathematical Optimization and Its Application to Adversarial Training (2022.findings-aacl)
Copied to clipboard
| Challenge: | Neural networks are vulnerable to adversarial examples due to slightly perturbed input data. |
| Approach: | They propose a method that evaluates the robustness of text classification models by an optimization problem that identifies a minimum synonym swap that changes the classification result. |
| Outcome: | The proposed method achieves high scores in human evaluations of grammatical correctness and semantic similarity for an IMDb dataset and implements adversarial training with the IMD and SST2 datasets. |
Training Language Models under Resource Constraints for Adversarial Advertisement Detection (2021.naacl-industry)
Copied to clipboard
| Challenge: | e-commerce and social media sites require content moderation to ensure ethical standards . a tiered moderation workflow with automated components complements human experts . |
| Approach: | They propose techniques for training text classification models under resource constraints . they use weak supervision, curriculum learning and multi-lingual training to fine-tune BERT . |
| Outcome: | The proposed techniques detect adversarial ads with a substantial gain over baseline . the authors show that the proposed methods can be applied to multiple languages . |
Lexical Features Are More Vulnerable, Syntactic Features Have More Predictive Power (D19-55)
Copied to clipboard
| Challenge: | Existing metrics to quantify lexical diversity have been proposed. |
| Approach: | They propose to examine how generic language characteristics are impacted by text alterations. |
| Outcome: | The proposed models show that lexical features are more sensitive to text modifications than syntactic ones. |
E-VarM: Enhanced Variational Word Masks to Improve the Interpretability of Text Classification Models (2022.coling-1)
Copied to clipboard
Ling Ge, ChunMing Hu, Guanghui Ma, Junshuang Wu, Junfan Chen, JiHong Liu, Hong Zhang, Wenyi Qin, Richong Zhang
| Challenge: | Empirical studies show that our approach outperforms the SOTA methods in improving the interpretability of text classification models. |
| Approach: | They propose an enhanced variational word masks approach that exploits the Variational Information Bottleneck to obtain task-specific words. |
| Outcome: | Empirical results show that the proposed method outperforms the SOTA methods in improving the interpretability of the model. |
On the Transferability of Adversarial Attacks against Neural Text Classifier (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing studies show that deep neural networks are vulnerable to adversarial examples . a small perturbation to an input alters the model prediction . |
| Approach: | They propose a genetic algorithm to find models that can induce adversarial examples to fool models . they propose word replacement rules that can be used for model diagnostics from these examples . |
| Outcome: | The proposed model can fool almost all existing models, while ignoring the data bias in the training set. |
Exploring the Trade-off Between Model Performance and Explanation Plausibility of Text Classifiers Using Human Rationales (2024.findings-naacl)
Copied to clipboard
| Challenge: | Saliency post-hoc explainability methods are important tools for understanding complex NLP models, but they may not align with human intuition, making the explanations not plausible. |
| Approach: | They propose a method for incorporating rationales into text classification models by augmenting the standard cross-entropy loss with a novel loss function inspired by contrastive learning. |
| Outcome: | The proposed approach enhances the plausibility of post-hoc explanations while preserving their faithfulness. |
Unsupervised Cross-lingual Transfer of Word Embedding Spaces (D18-1)
Copied to clipboard
| Challenge: | Existing methods for cross-lingual word mapping require cross-linguistic supervision, but this is not available for many low resource languages. |
| Approach: | They propose an unsupervised method that learns transformation functions over corresponding word embedding spaces using a distributed distributional matching algorithm. |
| Outcome: | The proposed method performs better on bilingual lexicon induction and cross-lingual word similarity prediction datasets than other supervised and unsupervised methods. |
Is Attention Interpretable? (P19-1)
Copied to clipboard
| Challenge: | Attention mechanisms have recently boosted performance on a range of NLP tasks. |
| Approach: | They propose to manipulate attention weights in text classification models and analyze the resulting differences in their predictions. |
| Outcome: | The proposed approach improves models' predictions by using gradient-based rankings of attention weights. |
An Effective Label Noise Model for DNN Text Classification (N19-1)
Copied to clipboard
| Challenge: | Existing methods to train deep neural networks with label noise are limited to image classification models . label noise is important because of the large number of errors and errors in training datasets . |
| Approach: | They propose a non-linear processing layer that models label noise into a convolutional neural network (CNN) they add a noise model layer on top of their target model to account for label noise . |
| Outcome: | The proposed approach is robust to label noise and can learn better sentences . it is based on extensive experiments on text classification datasets . |
A Ship of Theseus: Curious Cases of Paraphrasing in LLM-Generated Texts (2024.acl-long)
Copied to clipboard
Nafis Irtiza Tripto, Saranya Venkatraman, Dominik Macko, Robert Moro, Ivan Srba, Adaku Uchendu, Thai Le, Dongwon Lee
| Challenge: | Using a computational approach, we discover that diminishing performance in text classification models is closely associated with the extent of deviation from the original author’s style. |
| Approach: | They propose to use large language models to determine whether a text retains original authorship when it undergoes numerous paraphrasing iterations. |
| Outcome: | The results suggest that authorship should be task-dependent . |
Using Social and Linguistic Information to Adapt Pretrained Representations for Political Perspective Identification (2021.findings-acl)
Copied to clipboard
| Challenge: | a new framework for political perspective detection is proposed to improve text training costs . current deep learning models lack the ability to focus on text span for bias detection . |
| Approach: | They propose a framework that pretrains the text model using social and linguistic contexts . they demonstrate that the framework improves performance by identifying bias-related text spans based on entity mentions and news sharing . |
| Outcome: | The proposed framework improves on two news bias datasets and improves performance on the general source and task. |
Learning to Discriminate Perturbations for Blocking Adversarial Attacks in Text Classification (D19-1)
Copied to clipboard
| Challenge: | Existing studies on adversarial attacks on deep learning models focus on generation of adversarials and defense against adversarial attacks. |
| Approach: | They propose a framework to identify and adjust malicious perturbations and block adversarial attacks for machine learning models. |
| Outcome: | The proposed framework outperforms baseline methods in blocking adversarial attacks for text classification models. |
BAE: BERT-based Adversarial Examples for Text Classification (2020.emnlp-main)
Copied to clipboard
| Challenge: | Recent studies have exposed the vulnerability of text classification models to adversarial examples . perturbed versions of the original text are indiscernible by humans and misclassified by the model . |
| Approach: | They propose a black box attack for generating adversarial examples using contextual perturbations from a BERT-masked language model. |
| Outcome: | The proposed attack produces examples with improved grammaticality and semantic coherence compared to previous work. |
MBTI Personality Prediction for Fictional Characters Using Movie Scripts (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Existing NLP models cannot predict character's personality types based on text classifications . character comprehension is the cornerstone of understanding stories in psychology and education. |
| Approach: | They propose a benchmark to predict movie character's MBTI or Big 5 personality types based on the narratives of the character. |
| Outcome: | The proposed model outperforms existing models in the task and is more accurate than random guesses. |
LexicalAT: Lexical-Based Adversarial Reinforcement Training for Robust Sentiment Classification (D19-1)
Copied to clipboard
| Challenge: | Existing text classification models are fragile and sensitive to simple perturbations. |
| Approach: | They propose a generator-classifier adversarial training approach to improve classification models . they use a large-scale lexical knowledge base to generate attacking examples . |
| Outcome: | The proposed approach outperforms strong baselines and reduces test errors on neural networks. |
Synthetic Data Generation with Large Language Models for Text Classification: Potential and Limitations (2023.emnlp-main)
Copied to clipboard
| Challenge: | Recent studies have explored using large language models to generate synthetic datasets . however, the effectiveness of the LLM-generated synthetic data is inconsistent across different classification tasks. |
| Approach: | They propose to use large language models to generate synthetic datasets to better understand factors that moderate the effectiveness of LLM-generated synthetic data. |
| Outcome: | The results show that subjectivity is negatively associated with the performance of the model trained on synthetic data. |
Calibrating Pseudo-Labeling with Class Distribution for Semi-supervised Text Classification (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing studies develop effective pseudo-labeling methods, but they struggle with unlabeled data that have imbalanced classes mismatched with the labeled data. |
| Approach: | They propose to use pseudo-labeling to train text classification models with few labeled data and massive unlabeled data. |
| Outcome: | Empirical results show that the proposed model outperforms state-of-the-art methods on 3 common benchmarks. |
Contrastive Novelty-Augmented Learning: Anticipating Outliers with Large Language Models (2023.acl-long)
Copied to clipboard
| Challenge: | Existing methods for classification are overly confident on unseen examples . despite recent advances in NLP, some categories of distribution shift still pose serious challenges. |
| Approach: | They propose a method that generates OOD examples representative of novel classes and trains to decrease confidence on them. |
| Outcome: | The proposed method improves classifiers' ability to detect and abstain on novel class examples over previous methods by 2.3% and 5.5% over previous approaches. |
GAProtoNet: A Multi-head Graph Attention-based Prototypical Network for Interpretable Text Classification (2025.coling-main)
Copied to clipboard
| Challenge: | Existing models with black-box nature obscure decision-making process and lack interpretability. |
| Approach: | They propose a multi-head graph attention-based prototypical network that uses a vector and prototypes to learn an interpretable prototypical representation. |
| Outcome: | The proposed model achieves superior results without sacrificing the accuracy of the original black-box LMs. |
Robust Text Classification: Analyzing Prototype-Based Networks (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Language models exhibit a drop in performance on noisy data, which can cause classifiers to incorrectly change their predictions. |
| Approach: | They propose to use Prototype-Based Networks to classify examples based on their similarity to prototypical examples of a class (prototypes) they show that PBNs offer more robustness under both targeted and static adversarial attacks. |
| Outcome: | The proposed model is robust to noise and targets both targeted and static attacks. |
Navigating the Unknown: Intent Classification and Out-of-Distribution Detection Using Large Language Models (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Out-of-Distribution (OOD) detection requires great generalization capability . |
| Approach: | They propose a method that is cost-efficient, high-performing, highly robust and versatile enough to be used with smaller LLMs without sacrificing performance. |
| Outcome: | The proposed method is cost-efficient, high-performing, robust, and versatile enough to be used with smaller LLMs without sacrificing performance. |